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Conjugate times and regularity of the minimum 
time function with differential inclusions 

Piermarco Cannarsa and Teresa Scarinci 


Abstract This paper studies the regularity of the minimum time function, T(-), 
for a control system with a closed target, taking the state equation in the form of 
a differential inclusion. Our first result is a sensitivity relation which guarantees 
the propagation of the proximal subdifferential of T along any optimal trajectory. 
Then, we obtain the local C 2 regularity of the minimum time function along optimal 
trajectories by using such a relation to exclude the presence of conjugate times. 


Introduction 

This paper aims to refine the study of the regularity properties of the value func¬ 
tion of the time optimal control problem in nonparameterized form, that is, when 
the state equation is given as a differential inclusion. This problem seems hard to 
address by parametrization techniques, as it has been observed in the recent papers 

m, m, CD, and 0. 

Recall the minimum time problem consists of minimizing the time T over 
all trajectories of a controlled dynamical system that originate from an initial point 
x £ R" and terminate on a compact target set JfT C R". Specifically, the problem 
SP(x) is 

minT, (1) 
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where the minimization is over all absolutely continuous arcs y(-) defined on an 
interval [0, T ] that satisfy the differential inclusion 

fy{t) £F(y(t)) a.e. fe[0,r] 

\y( o)=x 

and the terminal condition y(T) £ .Yf. Here, F : M" K" is a Lipschitz continuous 
multifunction having a sublinear growth such that the associated Hamiltonian 

H(x,p) = sup (—v,p) (. x,p ) G R” x R" 

veF(x) 

is semiconvex in x and differentiable in p, whenever p ^ 0. The minimum time 
function, T(x), is defined as the optimal value in (|T}. 

The main object of our analysis are sensitivity relations, that is, inclusions that 
identify the dual arc as a suitable generalized gradient of the minimum time function 
T(-), evaluated along a given minimizing trajectory. The importance of such rela¬ 
tions is well acknowledged and will be made clear by the applications we provide 
to the differentiability of T(-). 

Sensitivity relations have a long history dating back, at least, to the papers G3, 
ED, E, and lf22l that studied optimal control problems of Bolza type with finite 
time horizon. In (8), such relations were adapted to the minimum time problem for 
the parameterized control system 

= t> 0 (3) 


assuming that: 

(i) PYY has the inner sphere property, and 

(ii) Petrov’s controllability condition is satisfied on dJff. 

For any optimal trajectory y(-) of ([3]) originating at a point x in the controllable set, 
the result of 0 ensures the existence of an arc p, called a dual arc, such that: 

• (y-.P) satisfies the Hamiltonian system 


f -y(0 = Vp H (y(.t),p(t)) 
\ p(t) e d~H(y{t),p(t)) 


0 <t<T(x) =: T 


together with the transversality condition 


(4) 


v 

P{J) = ~ H(y(T),-v)’ 

where v is any unit inner normal to at y(T); 

• p(t) belongs to the Frechet superdifferential of T(-) at y(t ) for all t £ [0, T (x)). 

In El, the above result was extended to nonparameterized control systems by de¬ 
veloping an entirely different proof, based on the Pontryagin maximum principle 
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rather than linearization techniques as in ©. in a, assumption (ii) above was re¬ 
moved, still keeping (i) in force, showing that p(t ) is either a proximal or a horizon¬ 
tal supergradient of T(-) at y(t), for all t £ [0, T (x)), depending on whether Petrov’s 
condition is satisfied or not at y(T(x)). 

With respect to sensitivity relations, the purpose of the present paper is to de¬ 
rive analogous inclusions for the the proximal subdifferential of the minimum time 
function; more precisely, we will prove the propagation of the subdifferential of 
T(-) along optimal trajectories. By ‘propagation of the proximal subdifferential’ we 
mean the fact that, if a proximal subgradient of T(-) exists at some point x of the 
reachable set—so that the minimum time function is differentiable at x —and >’(•) is 
a time optimal trajectory starting at x, then p(t) belongs to the proximal subgradient 
of T(-) at y(t) for all t & [0,r(x)). Such an invariance of the subdifferential with 
respect to the Hamiltonian flow associated with (Q} was pointed out in J4j for func¬ 
tionals in the calculus of variations and 0 for optimal control problems of Bolza 
type. A similar result was obtained in (6) for the Mayer problem and in lfl8l for 
the minimum time problem for parameterized control system. In Theorem [3]of this 
paper, we show that such a property holds for the minimum time problem with a 
state equation in the form of a differential inclusion. 

We give two applications of the above sensitivity relations. The first one (Theo- 
rem[5]below) ensures that the differentiability of T(-) propagates along an optimal 
trajectory, y(-), originating at a point x of the controllable set if and only if Petrov’s 
condition is satisfied at y[T (x)). This property follows directly from the above rela¬ 
tions which guarantee that the corresponding dual arc is contained in both Frechet 
semidifferentials whenever T(-) is differentiable at x . Our second application con¬ 
cerns the local smoothness of the minimum time function along an optimal trajec¬ 
tory y(-), that is, the property of having continuous second order derivatives in a 
neighborhood of {y(t ) : 0 < t < T (x)}. In Theorem[6] we show that this is indeed 
the case whenever T(-) has a proximal subgradient at the starting point of >■(•). 

In order to prove the local smoothness of T(-) along an optimal trajectory we 
need to analyze conjugate times, and give sufficient conditions to exclude the pres¬ 
ence of such times. The notion of conjugate point is classical in the calculus of 
variations and optimal control. Recently, conjugate times have been considered in 
ED linearizing the system on the whole R" but neglecting the role of the time vari¬ 
able. In such a paper, the degeneracy condition is assigned on the tangent space 
to the target, which is an (n — 1 )-dimensional space and the authors show that the 
absence of conjugate times at a point x ensures the C 1 -smoothness of '/'(•) along 
the trajectory originating at x. In this paper, we return to the ‘classical’ definition 
of conjugate point and formulate a sufficient condition for smoothness in terms of 
conjugate times (see Theorem|2]i, much in the spirit of the result of ED. 

In this way we deduce that, if the proximal subgradient of 7’(-) is nonempty at 
some point x, then the minimum time function is locally smooth along the optimal 
trajectory originating at x. 

The paper is organized as follows. Background material is collected in Section 
□ In Section [2] we recall preliminary results and discuss the main assumptions we 
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work with. Section[3]is devoted to the analysis of conjugate times. Section[4]contains 
our sensitivity relations and their applications to regularity. 


1 Notation 

Let us fix the notation and list some basic facts. Further details can be found in sev¬ 
eral books, for instance mmmm. 

We denote by | -1 the Euclidean norm in R" and by (•, •) the inner product. B(x. e) 
is the closed ball of radius e > 0 centered at x, and S" 1 the unit sphere in R". R" x " 
is the set of n x n real matrices and || Q || is the operator norm of a matrix Q, Q* 
is the transpose of (Q, ker Q is the kernel of Q, while /„ is the n x n identity matrix. 
Recall that || Q ||= sup{|(Ax,x)| : x G S'" -1 } for any symmetric n x n real matrix Q. 
Moreover, co E, dE, E and E c are the convex hull, the boundary, the closure and 
the complement of a set E C R", respectively. 

Let K be a closed subset of R" and x G K. N ( p (x) denotes the Clarke normal 
cone to K at x. A vector v G R is a proximal (outer) normal to K at x, and we write 
v G A^(x), if there exists a = cr(x, v) such that, for all y G K, 


(v,y-x)<(j\y-x\ 2 . 


(5) 


In K is a convex subset of R", the proximal normal cone to K at x coincides with 
the convex normal cone to K at x. 

A vector v is a proximal inner normal to K at x if v G N^ c (x). We call it an unit 
proximal inner normal to K at x if it belongs to the set N^ c (x) fl S" 

We say that K satisfies the inner sphere property of radius R, R > 0, if for every 
x G dK there exists a nonzero vector v x G A' 1 } (x) such that (0 holds true with 
<7 = \v x \(2R) 1 and v = V A and for all y G K c . Equivalently, for all x G dK there 
exists a vector 0 ^ V x G N^ c (x) realized by a ball of radius R, that is. 



Roughly speaking, if K satisfies the inner sphere property of radius R then we have 
an upper bound for the curvature of dK, even though dK may be a nonsmooth set. 
Indeed, any x G dK belongs to some closed ball y x +RB( 0, l)c^. This fact sug¬ 
gests that, in some sense, the curvature of dK is bounded above and excludes the 
presence of outward pointing corners on dK. 

If / : [foTi] -A R" is continuous, / G C([f 0 Ri]). define ||/||oc = max f6[(0itl] |/(f)|. 
Moreover, we usually refer to an absolutely continuous function x : [foTi] —^ R" 
as an arc. The space C k (£2), where Q is an open subset of R", is the space of all 
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functions that are continuously differentiable k times on £2. The gradient of / is 
V/(-), if it does exist. Moreover, if / is twice differentiable at some x £ £2, then 
V 2 /(x) denotes the Hessian of / at x. Let / : £2 —> R be any real-valued function 
defined on an open set £2 Cl". Let x £ £2 and p £ R". We say that: 

• p is a Frechet subgradient of / at x, p £ d~f{x), if 


y-« | y — x | 


• p is a Frechet supergradient of / at x, p £ <9 + /(x), if 

—'*> < 0 , 

y-yx \y-x\ 

• p is a proximal subgradient of / atx, p £ d~' P f(x), if 3 c, p > 0 such that 

f(y) ~ fix) - {p,y - x) > -c|y - x| 2 , Vy e B{x, p ), 

• p is a proximal supergradient of / at x, p £ d +,p f(x), if 3 c, p > 0 such that 

f(y)-f(x)-{p,y~x)<c\y-x\ 2 , Vy£B(x,p). 


If / is Lipschitz, £ £ R” is a reachable gradient of / at x £ £2 if there exists a 
sequence {xj } C converging to x such that / is differentiable at xy for all /' G N 
and ^ = lim^oo V/(x ; ). Let d*f{x) denote the set of all reachable gradients of / at 
x. The ( Clarke) generalized gradient of / at x € 12, <3/(x), is the set co (<3*/(x)). 
For an open set £2 C K”, / : L2 —^ Bi i s semiconcave if it is continuous in £2 and 
there exists a constant c such that 


f{x + h) + f[x - h) - 2 fix) < c\h\ 2 , 

for all x,h £ M" such that [x — h,x + h] C £2. We say that a function / is semiconvex 
on £2 if and only if —/ is semiconcave on £2. We recall below some properties of 
semiconcave functions (for further details see, for instance, ns). 

Proposition 1. Let £2 C M" be open, f : £2 K be a semiconcave function with 
semiconcavity constant c, and let x £ £2. Then, f is locally Lipschitz on £2 and the 
following holds true 

1. p £ R” belongs to <3 + /(x) if and only if, for any y £ £2 such that [y,x] C £2, 

f(y)-f(x)-{p,y~x)<c\y-x\ 2 . (6) 

2. dfix) = d + fix) = co id*fix)). 

3. Ifd + fix) is a singleton, then f is differentiable at x. 

If / is semiconvex, then (J6]» holds reversing the inequality and the sign of the 
quadratic term, and the other two statements are true with the subdifferential in- 
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stead of the superdifferential. 

Let M C R" be a C m -manifold of dimension n — 1 and fix (jo G M. Let A C R' 1 ” 1 
be an open set, let 0 : A —>- R" be a map of class C' n such that 0(A) C M, Dtj)(y ) 
has rank equal to n — 1 for all y G A and 0(t7o) = (jo for some rjo £ A. We call 
0 a local parameterization of M near (jo- The components (?]],...j]„ | j of a point 
T] = 0 _1 ((j) G A are usually called local coordinates of (j G M. 

An application F : M —>- R" is of class C k at (jo G M if the map F o 0 _1 : 0(A) —>• 
R" is of class C* at Vo := 0 _1 ((jo) for an y local parameterization 0 of M near (jo- 
Equivalently, F : M —> R" is of class C k at if there exists a local parameterization 
0 of M near such that F o 0 _1 is of class C k at 770 := 0” 1 (|o)- 


2 Assumptions and preliminary results 


The minimum time problem £P(x) consists of minimizing the time T over all tra¬ 
jectories of a differential inclusion that start from an initial point x G R" and reach 
a nonempty compact set ■"£ C R", usually called target. Specifically, for any abso¬ 
lutely continuous function y x {-) £ AC([0, +o°);M") that solves the differential inclu¬ 
sion 

iy{t) G F(y{t)) a.e. t >0 
\y(0) =X, 

let us denote by 

0(y*(-)):=inf{f>O: /(f) G JT} 


the first time at which the trajectory /(■) reaches the target ■"£ starting from x. 
By convention, we set 0(/(-)) = +°° whenever/(•) does not reach J(T. Here and 
throughout the paper, F : R" =4 R" is a given multifunction that satisfies the so- 
called Standing Hypotheses : 

{ l)F(x) is nonempty, convex, and compact for each x G R", 

2 )F is locally Lipschitz with respect to the Hausdorff metric, 

3)there exists p > 0 so that max{|v| : v G F(x)} < p(l + |x|). 

The minimum time function T : R" —> [0, +°°] is defined by: for all x G R", 


T(x) :=inf{0(/(-)) : /(•) solves 0}. (8) 


T (x) represents the minimum time needed to steer the point x to the target JF along 
the trajectories of 0. It is well-known that (.S//) guarantees the existence of ab¬ 
solutely continuous solutions to 0 defined on [0,+°°). Moreover, if x is in the 
reachable set Si (i.e. T (x) < +°°) then ^(x) has an optimal solution, that is, a so¬ 
lution to 0 that gives the minimum in 0. The main assumptions of this paper are 
expressed in terms of the Hamiltonian H : R" x R" —> R associated to F, that is, the 
function defined by 
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We shall suppose that 


H(x,p) = sup (~v,p). 

veF(x) 


(9) 


(H){ 


for every r > 0 

( i ) 3 c > 0 so that ,Vp £ S" ,x i —> H(x,p) is semiconvex on B(0,r) with 
constant c r , 

(ii) V p H(x,p) exists and is Lipschitz continuous in x on B(0,r), uniformly 
for p £ S" -1 . 


We recall that (H) was introduced for the minimum time problem in iflOl to 
derive sufficient conditions for the semiconcavity of the minimum time function. 
We refer the reader to mm for a detailed discussion of (//). 

Remark 1. Actually, in Il6l fl4l the authors suppose that the Hamiltonian // ' (x.p) := 
sup v6F ^ (v,p) satisfies (H). On the other hand, it is easy to compute that H + (x,p) = 
H(x , —p), and so H + satisfies (H) if and only if so does H. 


We recall below a classical result known as Maximum principle for the minimum 
time problem. It yields as necessary condition for the optimality of a trajectory x(-) 
the existence of a dual arc p(-) such that the pair (x.p) satisfies an Hamiltonian 
inclusion and a transversality condition. 


Theorem 1. Assume that ( SH ) and ( H ) hold. Suppose x(-) is an optimal solution of 
the minimum time problem &(x), reaching the target dfA at time T := T{x). Then 
there exists an absolutely continuous arc p : [0, T] —> ffi", /?(•) 0, such that for a.e. 

t£[0,T], 


f ~x(t) = VpH(x{t),p{t)), 
\ p{t) e d~H(x{t),p(t)), 


p(T)£N%r(x{T)). 


( 10 ) 


The classical formulation of the above theorem (see, for instance, ED) is expressed 
in terms of the “complete” Hamiltonian system (x,p) £ dll (x.p) (where dH stays 
for Clarke’s generalized gradient of H in (x, p)). However, the “splitting Lemma” in 
El (Lemma 2.9) guarantees that under our assumptions these two formulations are 
equivalent. 


Remark 2. Let us give two remarks. 

(a) Let (x,p) be a solution to the Hamiltonian inclusion 


f -x(t) £ d p H(x(t),p(t)), 
1 P(t) £ dfH(x(t),p{t)), 


a.e. in [f 0 ,T]. 


( 11 ) 


Then, there are only two possible cases: 

- either p(t) f- 0 for all t £ [to,T], 

- or p(t) = 0 for all t £ [to,T]. 
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Indeed, consider r > 0 such that x( [fo, T] ) C B(0,r). If we denote by c r aLipschitz 
constant for F on B(0,r), then c r \p \ is a Lipschitz constant for H(-,p) on B(0,r). 
Thus, 

ICI <Cr\p\ VC €d~H(x,p), Vx £ B(0,r), Xp£ R". 

Hence, |p(s)| < c,-|/?(s)| for a.e. s £ [fo, T], Therefore, Gronwall’s Lemma allows 
to conclude. 

(b) If (x,p) is a solution to (ITTb . then for any A > 0 the pair (x. Xp) solves (ITTb 
as well. Indeed, by the positive 1-homogeneity in p of the Hamiltonian, that 
is H(x,Xp) = XH{x,p) for all X > 0, x, p £ R", it follows that d x H(x,Xp) = 
Xd x H(x,p) and d p H(x, Xp) = c) p H (x,p) for all X > 0, x, p £ M". Thus, the proof 
of our claim is an easy verification. 

For our aims, sometimes we shall need more refined necessary conditions than the 
ones in Theorem Q] Assuming the interior sphere property on the target Jff allows 
to further specify the transversality condition. 

Proposition 2. Assume that ( SH ) and (II) hold. Suppose x(-) is an optimal solution 
for the minimum time problem &(x), reaching the target dXf at time T :=T (x), and 
that there exists 0 f V £ N p ^ c (x(T)) realized by a ball of radius R, that is, 

B^+R^R^j CJT. 

Then there exists an absolutely continuous arc p : [0,7"] —> R”, /?(•) ^ 0, such that 
for a.e. t £ [0, T], 


I -x(t) = V p H(x(t),p(t)), 
\ p(t) £ d x H(x(t),p(t)), 


p(T) = -v. 


( 12 ) 


Proof. The trajectory x(-) is time-optimal even for the problem obtained replacing 
the target JfT by the ball B\ := B(x(T)+Rv \ v Moreover, (x(T)) = 

{—v}. Thus, applying Theorem|T|to this new problem we prove our claim. 

Remark 3. If we suppose in addition that 

p(-v):=H(x(T),-v)- 1 >0, (13) 


then the above theorem together with Remark [2] (b) gives that there exists an ab¬ 
solutely continuous arc p : [0,2"] — > R", pf) ^ 0, such that (x,p) solves, for a.e. 

t g [o,r], 


J -x(f) = VpH{x{t),p(t)), , , 

\ p{t) £ d x H(x(t),p(t)), P{1) 


-p(-v)v. 


(14) 


In addition to our assumptions on F and //, further hypotheses on the target set 
might be needed, such as the inner sphere property and the so-called Petrov 
condition we recall below: 

(PC) 35 > 0 such that H{x, Q > 5||£|| for all x £ dJF and all C £ N P %- (x). 
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Assumption (PC) turns out to be equivalent to the Lipschitz continuity of the mini¬ 
mum time function T(-) in a neighborhood of JC. It is also necessary for the semi¬ 
concavity of T(-) up to a boundary of JC and equivalent to the validity of a bound 
of T in terms of the distance function from the target ,'Xf, which is defined as 

dx : R" — y R + , dx M := inf{ | y — x |: y £ Jf}. 

Recall, among the other things, that assuming Petrov’s condition on the target JC 
guarantees that ( fl3l ) always holds true. For a comprehensive treatment and further 
references on this subject we refer to the book CD- In sections [31 and 14.31 we shall 
also assume that JC is the closure of its interior and 

(A) dJC is an (n — l)-dimensional manifold of class C 2 . 

Whenever (A) holds true, JC satisfies the inner sphere property with a uniform 
positive radius. Moreover, the signed distance from the target JC, that is, 

bx : — * bx(j : = dx(j — dxc(j, 

is a function of class C 2 in a neighborhood of dJ(C, and —’Vbx(^) is a proximal 
inner normal to JC at B, £ dJC with unit norm. 


3 Conjugate times for the minimum time problem 

The aim of this section is to extend the main result in O] to the minimum time 
problem. More precisely, we show that the absence of conjugate times is equivalent 
to the propagation of the local regularity of the minimum time function. Let us 
mention that a partial result in this framework has been recently given in 1T81 . On 
the other hand, our notion of conjugate time is more in the spirit of ||2H and allows 
to recover a stronger result than the one in lfl8ll . 


3.1 Conjugate times for the minimum time problem 

In this section, we assume (57/), (PC), and (A) and suppose that the Hamiltonian H 
is of class C 2 (R" x (R" \{0})). Given B, € dJC, setg(|) := where 

is the positive constant H(B,, VT^^)) -1 . Recall also that, thanks to (A), 
the function g is of class C 1 in a neighborhood of dJ(C. Therefore, we denote by 
(Y(£, , j,P(%, •)) (or, briefly, by (Y (•),/’(■))) the solution of the backward Hamilto¬ 
nian system 


Y(t)=V p H(Y(t),P(t)), Y(0) = 4, 

P(t) = V x H(Y(t),P(t)), P(0) = *($)■ 


( 15 ) 
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We recall that for any tg G dJff the solution (T(-),P(-)) to (fl5l) is well-defined on 
[0, +°°) and the functions Y. P are of class C 1 with respect to g and the time in 
dYtff x [0, +°°) (for the proof of these facts see, for instance. Section 3 in (21]). 
Since is a C 2 -manifold of dimension n — 1, for any go G dJfP there exist a C 2 
local parameterization of dJ(Y: 

i) :AcR'' _1 ->R", 17 —>■ 0(t7) = t,. 

Set 770 := 0 -1 ( %o). Let us denote by and the Jacobians of 

Y (0(-), •) and P((j> (•),■) with respect to the state variable 77 G R ” _1 and time, that is, 

Therefore, note that Y^ t (tg,t) and P^ t (tg,t) belong to M" x " and the pair (Y^ t ,P^ t ) 
solves the variational system 

I Y^ = H xp (Y,P)Y^ t +H pp (Y,P)P^ t , Y^, 0) = ffjfa ),V p H(4,p)) , 

l -P U =H xx (Y,P)Y^ t +H px {Y,P)P^„ Pz,(S, 0 ) = , 

( 16 ) 

where we have set p := 77 ( 1 %)Vbjfp(!g). Matrix Y^ t (^,0) is invertible; indeed, by 
(PC) and the choice of p(-) it follows that 

Thus, the vector fi(lg)Vbjr(tg) is non-characteristic for the datag(-), that is, 

(VpHGMZWbjrMlVbMS))* 0. 

It is natural to introduce the following definition of conjugate time. 

Definition 1. Let Co € <9JC and let & a local C 2 parameterization of near Co. 
Let (Y^j.Ppj) be the solution to ( IT 6 l ). Define 

7 = supjf G [0, +°°) : detT^ r (^o,s) 7 ^ 0 for all s G [0,f]}. 

The time 7 is called conjugate for go iff < +°°. 

Thus, if 7 is conjugate for tgo then detT* ,(<i;o,7) = 0. 

Note that the solution ( Y^ tl P ^ t ) to (fl 6 l) depends on the parameterization 0. On 
the other hand, the ranks of the values of the maps Y^ t (<ijo, •) and P^ti^op) are 
independent of the particular choice of (j), as well as the above definition of conjugate 
time. 

By standard techniques one deduces that if det7,t 7 ^ 0, then there exists a 

neighborhood of (^ 0 ,t) in dYXf x R such that the matrix Y^ t (?g,s) is nonsingular 
for any vector (|,s) in such a neighborhood. Furthermore, if there are no conjugate 
times for Co on some interval [0,a], then the map Y(■.■) provides a diffeomorphism 
from a neighborhood J^ } x U, of (|o ,t) in x R onto its image for all t G [0,a]. 
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Moreover, it is easy to check that the function R(<gof) := P^ t (t,of)Y^ ,t), as 
long as is invertible, solves the Riccati equation 

ffi + H px (Y,P)R+RH xp (Y,P)+RH pp (Y,P)R + H xx (Y,P)= 0, 
\R(^,0)=P^O)Y^^o,0). (17) 


For a fixed d £ R" \ {0} and for any t > 0, let us denote by w(t) the 2/j-vector given 
by (Ijc t (£o,t)9,Pg t (!go,t)6). It is easy to check that w(-) solves a linear differential 
system with nonzero initial data, since Ijt ,(<i;o,0) has rank n. By well-known prop¬ 
erties of linear systems, it follows that w(t) f 0 for all t > 0. This means that for 
any 0 S 1 " \ { 0 } and t > 0 , 

Y^(Me = o =► p^fo,t)o?o. 

Therefore, it is easy to understand that a time 7 is conjugate for <go if and only if 
[0,7) is the maximal interval of existence of the solution R(^q 7 •) to (IT71) and 7 < +°°. 
Thus, 7 is a finite blow-up time for R(<g o, •), that is, 

Hm||R(^ 0 ,f) ||=+°°. 
tA 

If (Y,P) is given on a finite time interval [0,7’], then the above definition of con¬ 
jugate time can be adapted, by saying that 7 £ [0,7’] is a conjugate time for go if 
and only if detljc t (tgo 7 t) f 0 f° r all f G [0,7) and detljt ,(^o,7) = 0. Equivalently, 
7 is a conjugate time for <go if and only if R^ t (<go 7 -) is well defined on [0,7) and 
lim tA ll^,t(4o,0 ||=+°°- 


3.2 Local regularity of the minimum time function and conjugate 
times 

Let ^0 £ dJC and t > 0. Given an open neighborhood Vjc Q x 7, of (%o,t) in dJC x R, 
define the set 

M(V^xU,) := {(T(^,s),7 3 (^,s))| (Y,P) solves O with % £ V^, s £ U,}. 

When t > 0, the set U t may be viewed as an interval of the form (t — b,t + b) for 
some b > 0 and when t = 0 as the interval (O.b). 

Theorem 2. Let us assume (SH), (PC) and (A) and suppose that the Hamiltonian 
77 is of class C 2 (R' ! x (R" \ {0})). Fix 7 > 0. Then, the following two statements are 
equivalent: 

(i) for all t £ [0,7], there exists an open neighborhood x7 f of (<gof) in dJLL x R 
such that the set 


x I,) := {Y(B, 7 s)\(Y 7 P) solves (O, with % £ V^. s £ 7,} 


( 18 ) 


12 


Piermarco Cannarsa and Teresa Scarinci 


is an open subset of R", and M(V^ Q xl t ) is the graph of a C 1 function on X 

U t ); 

(ii) there are no conjugate times for on [0,7]. 

In C3, Caroff and Frankowska analysed the link between conjugate points and 
regularity of the value function V for Bolza optimal control problems, showing that 
the first emergence of a conjugate point corresponds to the first time when V stops 
to be locally smooth along optimal trajectories. In Theorem [2] we prove that the 
same kind of result holds true also for the minimum time problem. We note that our 
result cannot be deduced from the one in iT31 —even though the technique of proof 
is similar—because the definition of conjugate time we use in this paper is different 
from the one therein. For this reason, we give below the proof of the implication 
(ii) =>■ (i), which is the one needed to derive Theorem |6]below. 

Proof. Suppose that there are no conjugate times for tjo on [0,7]. We want to show 
that there exists a neighborhood V^ Q x 7, of (%of) in dJtf x R such that M(Vg () x U t ) 
is a graph of a C 1 function on £X?( V _ = () x 7,), for all t £ [0,7]. Actually, we shall prove, 
first, that M(V^ () x U t ) is a graph of a Lipschitz function with Lipschitz constant 
uniform in [0,7]. So, proceeding by contradiction, let us fix any neighborhood V7. x 
4 of (^o,l) in dJf x R and let us consider the compact set 77, := M(V^ x 7,) for all 
t > 0. It is a well-known fact that there exists a time t* > 0 such that 77, is a graph 
of a Lipschitz function for all t £ [0,?*]. Let a = sup .'Y, where 

SY := {t £ [0,7] : 3k, > 0 s.t. 77, is a graph of a k,-Lipschitz function 
<7> s : f^(Vje 0 x /,) -¥ M" for all sg [0,7]}. 

Aiming to a contradiction, suppose that a ^ i.e., 77,, is not the graph of a 

k-Lipschitz function. Then, fix t £ [0,a). Since detljt ,(^o,0 ^ 0’ without loss 
of generality, we can suppose that for any vector (£,s) £ V3 0 x 77, we have that 
detljt t (E, ,s) ^ 0. Moreover, Yx 77, —> R" is an injective continuous map. 
Thus, T(fjc 0 ,77,) is an open set by Brouwer’s invariance of domain theorem. Note 
that S>(V^ 0 xU t ) =Y (V^,77,). Consequently, S>{V^ 0 x 77,) is open and its closure is 

x 77,) := {y(^,s)|(y,P) solves (O with E, £ V^, s £ 77,}. 

Note that the map <7>, is a.e. differentiable on 57 (Lc. x 77,) for all t £ [O.a). Since TI a 
is not a Lipschitz graph, there exist two sequences 7, /7 1 a and {x ( }, e pj C 5?(Vje 0 x Ut t ) 
such that 

II D0 ti (Xj) ||-)- +oo. 

Equivalently, we can find a sequence of vectors v/C R" x R" such that 
D<P,fxi)ui = Vi , |v;| = 1 for all i £ N and |u,j —> 0 as i —» +°°. 

Since {x,},- 6 n C 0(V^ n x 77, ( ), there exist a sequence of vectors {<!;,■},■ C V7 (J and one 
of times s t £ U tj such that the solution (Y(fj. •),7 > (^,, •)) to ( ITtI i solves Y (^,i,-) = x, 
and P(|,-,Si) = <P,f xi). Now, let us consider the linearization of the system associ¬ 
ated to (y (E,i, -),P(^j, •)) at (. Xj,pi) given by the solution (w,-,^,) to 
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J Wi = H xp (Y(Zi,t),P(Zi,t))wi+H pp (Y(Zi,t),P(Zi,t))qi, wjsi) = u h 
\ -q t = H xx (Y(^,t),P(^,t))w i +H px (Y(^,t),P(^,t))q i , qjst) = v,-. 

Consequently, 

D<P ti (xi)wi(si) = qi(si), |w;0i)| -A 0 and |<?,(s,)l = 1- 

After possibly passing to a subsequence, we may assume that the sequence 
converges to some vector B, £ Vg g and {s;},eN to some time s £ U t , as i —> +°°. Then, 
passing to the limit as i —> +°°, it is easy to deduce from (l20l ) that the vector c has a 
conjugate time equal to s, i.e., det Y^ t (B,,s) = 0. Since (f,s) £ Vjc Q x U t , we obtain a 
contradiction. Therefore, J7, is a graph of a Lipschitz function for all t £ [0,7]. Since 
g is of class C 1 in a neighborhood of d.'/tf, by well-known properties of linearized 
systems we deduce that, for every parameterization (j) of Vjs () , 0, o © ~ 1 is of class C 1 
and (i) holds true. 

Remark 4. Suppose that the map <P, is of class C on the set S>(V^ Q x U,) for all 
1 G [0,7]. Then, it is easy to understand that its Jacobian is given by: for all B, £ VG () 
and sG(/ ( , 

D^ t {Y^,s))=P^,s)Y^,s)-\ 

in the sense that the matrix 


(19) 


( 20 ) 


PtiAM'nMYnAQi'n),*) 1 

represents the Jacobian of 0, at Y(t;,s) in the system oflocal coordinates (rji, ...rj„_i) 
induced by a parameterization 0 of 14.. 

A characteristic T(^,-), with B, G is said to be optimal in some interval 
[ 0 , t] if it coincides with an optimal trajectory y(-) starting from Y(%, t) running 
backward in time, that is, Y(%,t) =y(x—t), for all t G [0, t]. By the classical method 
of characteristics, one can deduce that any characteristic Y(B, , •) is optimal in [0, T*) 
for some time T* > 0. Theorem[2]allows to deduce that this result holds true as long 
as there are no conjugate times. 

Corollary 1. Let us assume (A) and suppose thatH is of class C 2 (R" x (R" x {0})). 
If there are no conjugate times for on the interval [0,7], then there exists a neigh¬ 
borhood of B,q in dJtf , Vfo such that Y (B, , •) is optimal on [0,7] for any B, G IA (J . 


3.3 A characterization of conjugate times 

In this subsection, let us assume (SH), (PC) and (A) and suppose that the Hamil¬ 
tonian H is of class C 2 (R" x (R" \ {0})). Let us denote by Y^(B,,t) and P^(B,,t) 
the Jacobian of T(0(-),f) and P((j)f),t) with respect to the state variable 77 G R "" 1 
evaluated at (<!;,f), that is, 
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Y^,t)=Y^(Tj),t), P^,t)=P r] {^{T]),t). 

One can easily check that the pair (<!;,•)) takes values in M nx (" _1 ) x 

l«x («— I) anc j so j ves j-jjg S y S tem 


{ h= h xp(Y,P)Y^ +H pp {Y,P)P. 5 , ¥&, 0) = J$(tj), 

\ = H„(Y,P)Ys +H px (Y,P)P^, Ptf, 0 ) = ( 0 ( 17 ))- 

In the case of a strictly convex Hamiltonian in p, the notion of conjugate time can 
be characterized through the solution of the above system (see El Theorem 6.1]). 
Let us now introduce the hypothesis: 

(H2) The kernel of H pp (x,p) has dimension equal to 1 for every (x.p) £ R" x 
(R" \ {0}), i.e., ker H pp (x,p) = p R. 

We will show that also under the weaker assumption (ZZ2) a similar characterization 
can be provided. 

Proposition 3. Suppose that H satisfies (H 2). For any t > 0, it holds that det Kc, (q . 1 ) 
0 if and only if rkY^ {E, ,t) <n — 1. 

To prove the above proposition, we need the following lemma. 

Lemma 1. Under the assumptions of Proposition\3\ it holds that, for any t > 0, 

^dety^(£,s) \ s=t ^Q 4=> rkY^ f (E,f)=n- 1. 

Proof First, suppose that rkY^ t (<gf) = n — 1. Following the same reasoning as in 
the proof of lEQ Lemma 4.3], we have that 

^detT^(^) | s=t =tr[H pp (Y^f),P^f))P^f)Y+^f)) , 

where A + denotes the transpose of the matrix of the cofactors of a matrix A, that 
is, AA + = A + A = ( detA)I„ . Moreover, if 6 is such that kerijc t (%of) = 0R, then by 
EU Lemma 4.2] there exists c > 0 such that 

^det Y^,s)\^=cH pp (Y^,t),P^,t))P^,t)9-P^,t)e. (22) 

We claim that P^ t {E,f)0 qL kerH pp (Y(^f),P(^f)). If not, there exists A G R\ {0} 
such that lf j(f -t)d = /LP(g.t). Now, observe that for all E, £ d.'X and all r > 0 it 
holds that H(Y(^,t),P(^,t)) = 1. Hence, taking the Jacobian of this map at (E,,t) 
and recalling that kerlje f (^o,0 = 0R we obtain that 

0 = {Y^,t)e, H x (Y(Z,t), p^,t))) + (p^ (Z,t)e, H P (Y(S,t),p(Z,t))) 

= (P^,t)d,H p (Y(^t),P^,t))). 
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On the other hand, since we are assuming that P^ t = XP(£,t), we have 

{P^,t)e,H p {Y^,t),P^t))) = (A P&,t)e,Hp{Y{$,t),P&,t))) 

= X(P^,t)e,H p (Y(^t),P(^t)))=XH(Y^,t),P^,t))=X, 

that is in clear contradiction with the equality that is above it. This finally shows that 
P^ t (^,to)0 ^kerH pp (Y(^f),P(^f)), and so from (l 2 ~ 2 l > we obtain that 

^;det Y^^,s) \ s=t > 0 . 

For the proof of the other implication, we refer the reader to the proof of ETl 
Lemma 4.3]. 

Proof (Proof of Proposition 0. It is sufficient to show that if det Yz, (q .t) = 0 
then rkY ^ (| ,0 <71—1. Aiming for a contradiction, suppose det Y^ t {B,,t) = 0 but 
rkY^ (£, , t) = n — 1. Hence, the vectors Ypf q ,f), i = 1,1, are linearly indepen¬ 
dent and, by continuity, there exists 5 > 0 such that for any time s £(t —8 f+ 8) the 
vectors Y^f^of), i = 1..... n — 1, are still linearly independent. We can distinguish 
to cases: 

1 . there exists a sequence of times 4 —>• t as k —>• °° such that detljc t (E, , 4 ) = 0 for 
all k, 

2 . there exists a constant 8' £ ( 0 , 8) such that detl^ t (8, ,s) 0 for all s £ (t — 8',t + 

8'). 

For the discussion of the first case, we refer the reader to the proof of 1211 Theorem 
6.1]. In the second case, we have that 

- 7 -det Y? S (£,s) ^ 0 for all s £ (t — 8',t + S'), 
as 

Then, Lemma[T|implies that rkYz, (f. t) <n — 1 and this yields the contradiction. 

Under the additional assumption (H 2), the above proposition gives an equivalent 
characterization of conjugate times considering only the spatial Jacobian of the map 
T(-, •)■ More specifically, it follows that a time 7 is conjugate for tjo if and only if 

7 = sup{f £ [0,+°°) : rkY^ (4o,s) = n — 1 for all.? € [0,f]}, 

and 7 < +°o. Consequently, rkY ^ (fo-7) <n — 1. 

Remark 5. Let us suppose that (H2) holds true. If there is no conjugate time for ^0 
on [0,7], then Y (f, •) maps a neighborhood/^ of Co in dJf onto the level sets of the 
minimum time function, that is, for all t £ [0,7], 

Y(t,-):I^^r t cR n ~\ 
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where r t := {x € K" : T(x) = f}. Moreover, Y (t. •) gives a diffemorphism from a 
neighborhood of Co in onto an open neighborhood of 17, for any time t smaller 
than the conjugate time 7. 


4 First-order sensitivity relations for the minimum time problem 
and some applications 

The scope of this section is twofold. First, we discuss some sensitivity relations 
of first order. Subsequently, we apply these results to derive sufficient conditions 
for the propagation of the regularity of the minimum time function along optimal 
trajectories. 


4.1 Proximal subdifferentiability of the minimum time function 

The forward propagation of the dual arc into the proximal subdifferential of T is 
already known for minimum time problems when the dynamic is described by a 
control system with sufficiently smooth dynamics (see jT8l ). We shall extend this 
result to the differential inclusion case. 

Theorem 3. Assume ( SH ) and ( H ) hold. Let xo G 2% \ -X, let x be an optimal tra¬ 
jectory starting from xo reaching JfT in time T[x o), and ~p : [0,T(xo)] —> R" be an 
arc such that (x.~p) solves the system: for a.e. t G [0,7’(xo)], 

f -x(t) G d~H(x(t),p(t)), x(0) = x 0 

I P(t) € d~H(x(t),p(t)), p(0) G d~ ,p T(xo). 

Then, there exist constants c,r > 0 such that, for all t G [0, T (xo)) and h G B(0, r), 

T(x(t) + h)-T(x{t)) > (p(t),h) — c | h \ 2 . 

Consequently, 

p(t) G d~ ,p T(x(t)) for all t £ [0 ,T(xq)). (23) 

Proof. First of all, recall that 0 ^ d~ ,p T(x o) (see, for instance, ll25l Theorem 5.1]), 
and so the dual arc ~p never vanishes on [0. 7'(xo)] by Remark [2] Since p(0) G 
d~’ P T (xo), there exist co,ro >0 such that for every h G B( 0, ro), 

T(x 0 + h)-T(x 0 ) > (p{0),h)-c 0 \h\ 2 . (24) 

Fix t £ (0, T (xo)). Recall that x(-) is the unique solution of the final value problem 

f — x(s) = V p H(x(s),p(s)) for all s G [0,f], 

\x(f) =x(f). 
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For all h £ B, let x/, (■) be the solution of the system 


—x(s) = V p //(x(s),/?(s)) for all s £ [0,f], 

x(f) = x(f) +/z. 


From the optimality of x(-) and the dynamic programming principle we deduce that 

(25) 


T(x{t)+h)-T(x(t)) - ( P(t),h) = T(x h {t))-T(x(t))-(p(t),h) 
> T (x h (0)) - T (x 0 ) - (p{t ), h). 


From the sublinearity of F and (77)(;;), using a standard argument based on Gron- 
wall’s lemma, one can show that there exists k > 0 , independent of t £ ( 0 .7'(xo)), 
such that 

||x/, — x||oo < e kT | h |, \/h£B. (26) 

For all h £ B(0,r) with r := min{l,roe _<:r }, by (1241 . (l25l > and (f26t we have that 


T(x(t)+h) — T(x(t)) — (p(t),h) > -(p{t),h) + (p(0),x h (0)-x 0 )-c 0 | x/,(0)-x 0 | 2 . 

(27) 


Moreover, 


_ _ ft d _ 

(p(0),x/,(0) -x 0 ) - = ~ J —-x(s)) 7s 

= ~ ~x(s)) + (p(s),x h (s) -t(s))^ds 

= ~J ((P(s),x/,(s)-x(s))-H(x/,(s),p(s))+H(x(s),p(s))Jds. 

Since p(s) £ dfH(x(s),~p(s)) a.e. in [0, F(xo)], assumption (H) (/) implies that 

(p(0),x/i(0) —x 0 ) — (p(t),h) >c 2 [ |p(s) ||x/,(s)-x(s) | 2 , (28) 

7o 

where C 2 is a suitable constant independent from t £ (0, T (xo)). From (I26b-(l28b we 
obtain our conclusion. 

Theorem 4. Assume (SH ) and (77) hold. Let xo £ Sf \ let x he an optimal tra¬ 
jectory starting from xo reaching TfT in time T[xf), and ~p : [0,T(xo)] —> K" be an 
arc such that (x,p) solves the system: for a.e. t £ [0, T(xo)], 

/ x(t) £ d~H(x{t),p{t)), x(0) = xo 

\ p{t) £ dfH{x(t),p{t)), p{0) £ d-T(x 0 ). 


Then, p(-) satisfies 


p(t) £ <5 T{x{t)) for all t £ [0 ,T(xq)). 


( 30 ) 
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Proof. The proof of the case ~p f 0 is similar to the proof of the above theorem. As 
the case J> = 0, we refer the reader to the proof of (6j Theorem 2.1], where we have 
described a strategy for constructing perturbations of the optimal trajectory when 
the dual arc is vanishing. 


4.2 First application: differentiability of the minimum time 
function 

Here, we provide some sufficient conditions in order that the optimal trajectories 
starting from a point in the domain of differentiability of the minimum time function 
T (•) stay in such a set whenever Petrov’s condition is satisfied at the final point of 
the optimal trajectories. The same result has been obtained in lfl8l in the case of 
smooth targets and smooth control systems with a Hamiltonian of class C 1,1 . Let 
us also mention that the fact that T(-) is differentiable along an optimal trajectory 
starting from x for all time in the open interval (0, T (x)) has been proved earlier in 
El in the case of exit-time problems with smooth control systems and a strongly 
convex Hamiltonian in p, under the Petrov condition {PC). More recently, in ifTTI 
this result was extended to the case of differential inclusions whit a strictly quasi- 
convex Hamiltonian in p. On the other hand, in our context the Hamiltonian is no 
longer strictly convex being 1-homogeneous in p and, in general, is not strictly 
quasi-convex, as shown by fTTl Example 1.]. Here, the Hamiltonian is only assumed 
to satisfy (H), while the target is supposed to satisfy an interior sphere property. 

Theorem 5. Assume that ( SPt ) and (H) hold. Let xo £ \ JtL, let x be an optimal 

trajectory starting from xo reaching the target dfL at time T{x o). Let R > 0, and 
suppose that JC is a nonempty subset of R" and satisfies the inner sphere property 
of radius R. Suppose, moreover, that H(x{T),v ) > 0 for any V £ N^(x{T)), V f 0, 
and T is differentiable at xo- Then, we have that T is differentiable at x(t) for all 

t g [o,r(x 0 )). 

Proof. Showing that T is differentiable at a certain point z is equivalent to prove 
that d + T{z) and d ~T{z) are both nonempty. Thus, the conclusion in the case (b) 
comes from Theorem[4]together with j9j Theorem4.1]. 


4.3 Second application: local C 2 regularity of the minimum time 
function 

Theorem[2] and 0 apply to show that the existence of a proximal subgradient of T’(-) 
at x is sufficient for the local regularity of T(-) in a neighborhood of the optimal 
trajectory starting form x. The proof is based upon ideas from 012). 

Theorem 6. Assume (57/), (A), (PC) and suppose that H is of class C 2 (R" x (R' ! \ 
{0})). Let xq £ Sf \ dff and let x be an optimal trajectory starting from xq reaching 
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JC at time T(x o). If d p T{x o) f- 0, then T is of class C 2 in a neighborhood of 
x{\OJ(x 0 ))). 

Proof. Recall first that the minimum time function T is semiconcave (see Col). 
Thus, it is well known that since d~ p T{x o) f 0. 7 must be differentiable at xo- 
Therefore, the optimal trajectory for xo is unique, and we call it x. It reaches the 
target at time T (xo). Set (jo := x(T (xo)). 

Thanks to assumption (PC), T is differentiable at x(t) for all t G [0,P(xq)) (see 
Theorem^- Recall that and -Vbx'i^f) is a proximal inner normal to ./C at (jo with 
unit norm. Thus, f>(t) = VP(x( t)) where p : [0,P(xo)] —» R" \ {0} is such that the 
pair (3c, p) solves: for a.e. t G [0,P(xq)], 


f -x(f) = V p H(x(t),p(t)), 
\ p(t) G d x H(x(t),p(t)), 


P(T) 


-V^(^)//(^o,V^(^o))- 1 . 


Set Y ((jo, ■) = x(P(x 0 ) — ■) and />(&, •) = p(P(x 0 ) - •)■ Thus, (y(§,, .),/>(&,•)) 
solves G3- 

Thanks to Theorem [2] it is sufficient to prove that the interval [0, T (xo)] does not 
contain any conjugate time for (jo- Let us proceed by contradiction, assuming that 
there exists a conjugate time t for (jo with t G (0, T (xo)). Fix t G (0,F). By Theorem 
[2] we deduce that there exists an open neighborhood V / = (| x U t of (fn-t) in d.'/P x R 
such that the function P(-) is of class C 2 in the open neighborhood Y(y^ Q ,U t ) of 
Y ((jo ,t). Furthermore, the Hessian of T is 

D 2 T{Y^,s))=R^,s)-P^,s)Y^^,sf ((j,s) G V^ 0 x U t , (31) 

where (Pc ; , Kc j is the solution to ( 1 1 6| i. Recall that equality (OH has to be under¬ 
stood in the sense that we have explained in Remark[4] Thus, for all ((j. ,v) G V^ 0 x U r 
we have that 


T(Y^,s)) - T(Y ((jo,f)) - (VP(F((jo,f)),F((j,.s)-y((jo,f)} 

- l -(R^of)(Y(^s)-Y(^t))J(^s)-Y(^t))=o(\Y^,s)-Y(^t)\ 2 ). 

(32) 


Moreover, since —p(0) G d P T (xo), by Theorem [3] there exists R$ > 0 and co > 0 
such that 

T(y)-T(Y^ 0 ,t))-(WT(Y^ 0 ,t)),y-Y^ 0 ,t))>-c 0 \y-Y(^,t)\ 2 , (33) 

whenever y G B(F((jo,f),Po) and t G [0,P(xo)]. Without lost of generality, we can 
suppose that Y(V^ 0 ,U t ) C B(Y ((jo,f),/?o)- Then, by OH and OH . 

{R^ t {^f){Y^,s)-Y{^p)),Y^,s)-Y{^p))>-c 0 \Y^,s)~Y^t)\ 2 , (34) 

for all ((j,s) G x U t . Since Y(V^ Ql U,) is an open neighborhood of Y ((jo f) in R", 
from 04l) we deduce that 
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{R^ 0 ,t)e,o)>-c 0 , veer 1 . (35) 

This provides a bound from below, uniform in [0, F), of the quadratic form associ¬ 
ated to R^ t (^o,t). Furthermore, since T is semiconcave it holds that for any v G R" 

-)2 '-p 

such that | v |= 1 we have < C in the sense of distributions, where C is the 
semiconcavity constant of T (see, for instance, Proposition 1.1.3]). Since T is 
twice differentiable on Y(V^ 0 ,U t ) for all t G [0,7), the distributional Hessian coin¬ 
cides with the classical Hessian (f3T1) on such sets. We conclude that R^ t (^of) must 
be bounded from above on [0,7) by C, still in the sense of quadratic form. On the 
other hand, the operator norm of R = t (^o-f) goes to infinity as t —> 7, since we have 
supposed that 7 is conjugate for £,q. These facts together give a contradiction. Sum¬ 
marizing, we have proved that the all interval [0. T (xq)] does not contain conjugate 
times for (jo, and we conclude by Theorem [2] that the minimum time function T is 
of class C 2 in a neighborhood ofx([0,F(xo))). 

Example 1. Here are some examples of systems with a smooth Hamiltonian. We 
consider a dynamic x = /(x, m) given by the control-affine system with drift: 

f{x,u) = h{x) +F(x)u, u G U 1 (36) 

where U C R" 1 is the closed unit ball, h : R" —>■ R" is the drift and F : R” —t R" xm 
is a matrix-valued function defined by m vector fields f) : R" — > R", i = 1,as 
F(-) = [/j Suppose hereafter that the vector fields h and/), i = 1 

are of class C 2 with sublinear growth. The Hamiltonian associated to this system is 

H{x,p) = (p,h(x))+ | F(x)*p | . 


We give the following two examples: 




We assume that F(x) is surjective for all x 6 R (that is, m > n and that the rank 
of F(x) is equal to n for all x G R" ). Note that if F(x) is surjective, then F(x)* is 
injective. So its kernel is reduced to the singleton set {0}. Thus, for all x. p G R”, 

o. 


H p (x,p) =h(x) + 


F{x)F*{x)p 

\F*(x)p\ 


u , ^_F(x)F*(x) F(x)F(x)*p®F{x)F*{x)p 

pp{x,p) ~ mP 


Thus, F satisfies assumption (SH) and H is clearly of class C 2 (R" x (R" \ {0})). 
Note that also hypothesis (H2) is satisfied. Similarly, we can consider strictly 
convex sets U with sufficiently smooth boundary. 

Let us remark that the special case where m = n, h = 0 and F(x) is invertible for 
all x G R" corresponds to a Riemannian type problem. We are not in the standard 
Riemannian situation whenever F(x) is not invertible, and in particular when 
m < n. We deal with subriemannnian type problems in the example below. 

• We consider the control system (1361 without drift, i.e. h = 0. Let us first recall 
the notion of singular optimal trajectory for such control system. Let us introduce 





Conjugate times and regularity of the minimum time function 


21 


the pre-Hamiltonian 


m 


H 0 (x,p,u) = Y, u ‘(Pi’M x ))’ 


i=l 


that is smooth on R" xR"xi/ because of the smoothness of the fields j\. A 
trajectory x : [0,7’] —>• R" reaching the target at time T (and corresponding to 
the control w(-)) is said to be singular if and only if there exists an absolutely 
continuous arc p : [0,7’] —»R"\{0} such that (x(-), p(-),u(-)) solves the system 



(37) 


and p(-) is orthogonal to each vector f\ (x(-)), ...,/ m (x(-)) on [0,3"] (i.e. p(t) £ 
ker F(x(t))* for all t £ [0,3]). The control u is said to be singular as well. 

Let x(-) be a nonsingular optimal trajectory and let ~p{-) a dual arc solving (l37l > 
and such that ~p[s) (jL ker,F(x(.s))* for a time s in the interval [0,7’]. Thus, even 
if F(-) is not surjective, in a neighborhood of (x(-),/?(•)) the Hamiltonian H 
satisfies assumption ( H ) and is of class C 2 , and (x(-), /?(•)) solves also the system 



(38) 


To conclude, we recall that a sufficient condition to exclude the presence of non¬ 
trivial singular control is that the distribution corresponding to is fat, 

i.e., the control system is strongly bracket generating. There is a vast literature 
devoted to this topic. The interested reader is referred to, e.g., U9l[20l for more 
details on geometric control. 
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